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Abstract 

Communicating arbitrarily correlated sources over interference channels is considered in this paper. 
A sufficient condition is found for the lossless transmission of a pair of correlated sources over a 
discrete memoryless interference channel. With independent sources, the sufficient condition reduces to 
the Han-Kobayashi achievable rate region for the interference channel. For a special correlation structure 
(in the sense of Slepian-Wolf, 1973), the proposed region reduces to the known achievable region for 
^vq ' interference channels with common information. A simple example is given to show that the separation 
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approach, with Slepian-Wolf encoding followed by optimal channel coding, is strictly suboptimal. 

Index Terms 

Interference channels, correlated sources, lossless transmission, source channel code, separation 
approach 

I. Introduction 

Communicating correlated sources over multi-terminal networks have been a topic of research 
interest in the past decades. Slepian and Wolf [1] studied communicating correlated information 
over a two-user multiple access channel where the correlation is of a special structure in the form 
of three independent sources, with one of them observed by both encoders while each of the other 
two observed only at individual encoders. Later, Cover, El-Gamal, and Salehi studied the problem 
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this paper was presented in part at the 47th Annual Allerton Conference on Communication, Control, and Computing, Montecillo, 
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of communicating discrete correlated sources over a multiple access channel (MAC) [2], where 
the correlation structure can be arbitrary. A sufficient condition was obtained for the lossless 
transmission of such correlated source pair that includes various known capacity results as its 
special cases. These include the capacity region for a MAC [3], [4]; distributed lossless source 
coding, i.e., the Slepian-Wolf coding [5]; cooperative multiple access channel capacity; and 
the correlated source multiple access channel capacity region of Slepian and Wolf [1]. The key 
technique used in [2], aside from making use of the so-called common part of correlated random 
variables (in the sense of Gacs, Korner [6] and Witsenhausen [7]), is the correlation preserving 
codeword generation. By generating codewords that depend, probabilistically, on the source 
sequences, the correlation between the sources induces correlation in the generated codewords. 
In addition, a simple example was given to show that the separation approach which concatenates 
a Slepian-Wolf code [5] and the optimal channel code for MAC [3], [4] is strictly suboptimal. 

Han and Costa [8] studied the problem of communicating arbitrarily correlated sources over a 
discrete memoryless broadcast channel. The sufficient condition derived in [8] (with correction 
by Kramer and Nair [9]) recovers the Marton region for broadcast channels with independent 
messages [10, Theorem 2]. In [11], Minero and Kim proposed an alternative coding scheme 
and the obtained region was shown to be equivalent to that of Han and Costa. In addition, it 
was pointed out in [11] that the common part does not play a role for the broadcast channel 
case which is consistent with the engineering intuition because of the centralized transmitter. 
We comment here that the same coding scheme proposed by Han and Costa can also be easily 
modified to obtain the same region without the use of the common part, as to be elaborated in 
Section II. 

Communicating correlated sources over interference channels has previously been studied by 
Salehi and Kurtas [12]. However, the obtained rate region, derived by largely following the 
coding scheme for the MAC channel [2], [13] does not reduce to the well known Han and 
Kobayashi (HK) region for interference channels [14] when the sources are independent. We 
remark here that the HK region, originally proposed in 1981 [14] and recently simplified by 
Chong et al [15], remains to be the largest achievable rate region for interference channels with 
independent messages. In addition, there is no definitive answer to the question whether the 
separation approach is strictly suboptimal, even though intuition suggests that this is likely the 
case. 
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In this work, we derive a sufficient condition for the lossless transmission of a pair of arbitrarily 
correlated sources over a discrete memoryless interference channel (DMIC). The coding scheme 
takes advantage the common part of the random source pair, if it exists. Moreover, it utilizes 
the correlation preserving technique for the multiple access channel [2] and the random source 
partition for the broadcast channel [8]. We show that the proposed region includes the HK region 
as its special case. In addition, for a special correlation structure (in the sense of Slepian-Wolf, 
1973 [1]), the proposed region coincides with the known achievable region for interference 
channels with common information [16]— [18]. We also give a simple example to show that the 
separation approach for communicating correlated sources over interference channels is strictly 
suboptimal. 

The rest of this paper is organized as follows. Section II gives the problem formulation and 
introduces some previous results related to this work. The main results are presented in Section 
III. In Section IV, a simple example is given to show that separation is strictly suboptimal for 
communicating correlated sources over interference channels. Section V concludes this paper. 

II. Definitions, Problem statement and Related works 

The model studied in this paper is shown in Fig. 1. The source sequences (S n ,T n ) are 
arbitrarily correlated discrete memoryless sources, generated independently according to: 

n 

p(s n x) = Y[p( Sl ,t t ). (i) 

This pair of source sequences S n and T n are to be transmitted losslessly over a two user discrete 
memoryless interference channel defined by the transition probability p(yiy2\xix 2 ), where X i: X 2 
are the channel inputs and Y 1: Y 2 are the channel outputs. 

A length n source channel block code for the channel consists of two encoder mappings: 

h : S»-#[\ (2) 
h : T n — ► Xg, (3) 

01 : Dtf-S", (4) 

2 : y^T n . (5) 



and two decoder mappings: 
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Fig. 1. Interference channels with correlated sources. 



The probability of error at decoders 1 and 2 are defined as 

Pel = Yl p(s n )Pr{s n ^dM\S n = s n }, (6) 

s n es n 

Pe2 = Yl P(t n )Pr{t n ^d 2 (y%)\T n = t n }. (7) 
t n eT n 

Definition 1: The source (S,T) ~ Yli=iP( s h^i) is said to be admissible for the interference 
channel p(yiy 2 \xix 2 ) if for any e e (0, 1) and sufficiently large n, there exist a sequence of 
block codes (/i, / 2 , </>i, 2 ) such that 

max{P el ,P e2 } <e. (8) 
The goal of this paper is to find a sufficient condition such a source (S,T) is admissible for 

a given DMIC. In the following, we summarize some previous results related to this work. 
Cover, El Gamal, and Salehi [2] obtained the following sufficient condition for the lossless 

transmission of arbitrarily correlated sources over a multiple access channel. 

Proposition 1: ( [2, Theorem 1]) A source pair (S n , T n ) ~ YYi=iP( s i^i) can be sent w ^ n ar " 

bitrarily small probability of error over a discrete memoryless multiple access channel p(y\x\, x 2 ) 

if 

H(S\T) < I(X i; Y\X 2 SW), (9) 
H(T\S) < I(X 2 ;Y\X 1 TW), (10) 
H{ST\K) < I(X 1 X 2 ;Y\KW), (11) 
H(ST) < I{X X X 2 -Y), (12) 

where 

p(s, t, w, x ± ,x 2 , y) = p(w)p(s, t)p(x 1 \sw)p(x 2 \tw)p(y\x 1 x 2 ), (13) 
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and K = f(S) = g{T) is the common part of two variables (S, T), in the sense of Gacs, Korner 
[6] and Witsenhausen [7]. 

The key technique in deriving the sufficient condition is the correlation preserving code- 
word generation. For fixed distribution p{w),p{x\\w, s),p(x 2 \w, t), independently generate one 
codeword w n (k n ) ~ YYi=iP( w i) f° r eacn ^™ e ^- n > to carry the information of the com- 
mon part. Next, for each source sequence s n e S n , find the corresponding k n = f(s n ) = 
(/( s i)j f( s 2), ■ ■ ■ , f( s n)) and independently generate one codeword x\ ~ Y\a=i P{ x u\ s ii w i)- 
The codeword x r 2 l is similarly generated. Therefore the correlation between the sources induces 
correlation in the generated codewords, the so-called correlation preserving codeword generation. 
To transmit s n , encoder 1 sends the corresponding codeword x". Similarly encoder 2 sends the 
corresponding codeword x% for the given source sequence t n G T n . The decoder uses joint 
typicality decoding: upon receiving y n , the decoder finds a unique pair of (s n ,t n ) such that 
(s n , r, k n , w n , x^, x%, y n ) G T^STKWX^Y). 

Han and Costa [8] proposed the following sufficient condition for the lossless transmission of 
arbitrarily correlated sources over a discrete memoryless broadcast channel. 

Proposition 2: (Han and Costa [8], with correction by Kramer and Nair [9]) A source pair 
(S n ,T n ) ~ Iir=iP( s *'^) can b e sent with arbitrarily small probability of error over a dis- 
crete memoryless broadcast channel p(yiy 2 \x) if there exist auxiliary random variables W, U, V 
satisfying the Markov chain property ST — > WUV — > X — > YiY 2 such that 

H(S) < HSWUiYj - I(T;WU\S), (14) 

H(T) < I(TWV;Y 2 ) - I(S;WV\T), (15) 

H(ST) < mmil^KW-Y^J^KW-Y^ + I^SU-^KW), (16) 

+I(TV;Y 2 \KW) -I(SU;TV\KW), (17) 

H(ST) < I(SWU;Y 1 ) + I(TWV;Y 2 )-I(SU;TV\KW)-I(ST;KW), (18) 

where K = f(S) = g(T) is the common part of the two variables. 

The key technique that is of particular use to our problem is the random source partition, which 
reminisces superposition coding for the channel coding problem. Specifically, source sequences 
s n E S n , t n E T n are randomly placed into 2 nTl and 2 nr ' 2 cells, respectively. The cell indices 
for s n and t n , denoted by a and (3, respectively, play the role as the common information 
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to be decoded by both receivers. The coding scheme is sketched as follows: fix distribution 
p(w),p(u\w, s), and p(v\w,t). For each a, (3 and k n , independently generate 2 np0 codewords 
w n (a, (3, k n ) ~ YYi=\P{ w i)- Next, for each pair of (s n ,w n ), independently generate 2 npl code- 
words u n (s n ,w n ) ~ YIi=iP( u i\ s ii w i)> an d 2 np2 codewords v n (t n ,w n ) ~ YYi=iP( v i\' t: i^ w d- F° r 
each pair of source sequences (s n ,t n ), the encoder will choose a triple (w n ,u n ,v n ) such that 
(s n ,t n ,k n ,w n ,u n ,v n ) G T"(STKWUV), which is ensured with high probability by properly 
chosen p±, p 2 and p 3 . The two decoders use joint typicality decoding, that is, decoder Y 1 will 
find a unique sequence s n such that (s n , k n , w n , u n , y") G T™(SKWUYi). Similarly, decoder Y 2 
will find a unique sequence T such that (t n ,k n ,w n ,v n ,y%) G r e n (TXV^yy 2 ). 

In [11], Minero and Kim proposed an alternative, and conceptually simple, coding scheme. 
The obtained region does not involve the common part K of the two variables (S,T), but was 
shown to be equivalent to that of Han and Costa. In addition, it was pointed out in [11] that 
the common part does not play a role for the broadcast channel case which is consistent with 
the engineering intuition because of the centralized transmitter. Indeed, the same coding scheme 
proposed by Han and Costa can also be easily modified to obtain the same region without the 
use of the common part. For the encoding scheme in [8], sketched above, remove the part related 
to the common variable K, in both the encoding and decoding processes, straightforward error 
probability analysis leads to the following sufficient conditions: 

H(S) < HSWUiYi) - I(T;WU\S), (19) 

H{T) < I(TWV;Y 2 ) - I(S;WV\T), (20) 

if (ST) < min{7(W;Y 1 ),7(W;y 2 )} + 7(SC/;Y 1 |W), (21) 

+I(TV;Y 2 \W) -I(SU;TV\W), (22) 
H(ST) < I(SWU;Y!) + I(TWV;Y 2 ) - I(SU;TV\W) 

-I(ST;W), (23) 

where W, U, V satisfying the Markov chain property ST — > WUV — > X -^Y{Y 2 . 

This region is the same as in [11, Theorem 3.1], which was shown to be equivalent to that 
described in Proposition 2. 

For interference channels with independent messages, the largest achievable rate region was 
given by Han and Kobayashi [14]. The HK region was recently simplified by Chong et al and 
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we repeat in Proposition 3 this simplified HK inner bound. 

Proposition 3: (Chong et al [15, Theorem 2]) Let V be the set of probability distributions 
that factor as P(q, wi, w 2 , %i, x 2 ) = p(q)p(wi\q)p(w2\q)p(xi\wiq)p(x2\u>2q)- Then the rate pair 
(Ri,R 2 ) is achievable for a discrete memoryless interference channel p(yiy2\xix 2 ), if the fol- 



lowing conditions are satisfied: 

R 1 < I(X 1 ;Y 1 \QW 2 ), (24) 

R 2 < I(X 2 ;Y 2 \QW l ), (25) 

R ± + R 2 < I(X 1 ;Y 1 \QW 1 W 2 ) + /(W^; Y 2 \Q), (26) 

Ri + R 2 < I(X 2 ;Y2\QW 1 W 2 ) + I(W 2 X 1 ;Y 1 \Q), (27) 

R ± + R 2 < I(W 2 X 1 ;Y 1 \QW 1 ) + I(W 1 X 2 ;Y 2 \QW 2 ), (28) 
2R! + R 2 < HXnYilQWiWz) + 

I{W 2 X 1] Y X \Q) + J(^iX 2 ; Y 2 \QW 2 ), (29) 
i?i + 2i? 2 < I(X 2 ;Y 2 \QW 1 W 2 ) + 

1(^X2; Y 2 \Q) + I(W 2 X 1 ; Y^QWi). (30) 

III. Main results 



We start with a quick review of the HK achievable rate region of interference channel with 
independent messages. The major ingredients in the coding scheme for the HK region is rate 
splitting and joint decoding. Specifically, user i, % — 1, 2, splits the message M; into two parts, 
common message M i0 and private message Mn . Therefore, | Mj | = | M i0 \x\Mn \ where | • | denotes 
the cardinality of a set. The common message needs to be decoded by both decoders and the 
private message is only intended for its own receiver. This rate splitting can be implemented 
using sequential superposition encoding as described in [15]. Let Rij = ^ log |M^-|, % — 1, 2 and 
j = 0,1. First generate 2 nRi0 auxiliary codewords u>™, which carry the information of common 
message M i0 . Next, for each W™, generate 2 nRl1 codewords xf superimposed on top of wf, 
which carry the information of the private message Mn. Each decoder jointly decodes both 
common messages and its own private message, i.e., decoder 1 finds unique codewords w", 
and x r { such that (u>", w 2 , x\ , y") G T^{W\W2X\Y\), and decoder 2 finds unique codewords 
w?,w% and x% such that (w?, w%, x%, y%) G T™(yV x W 2 X 2 Y 2 ). 
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Consider now the model of interest in the present paper, i.e., IC with correlated sources. Let 
us first disregard the common part K between the source variables S and T. We start with 
Han and Costa's random source partition: the sequences s n e S n and t n e T n are randomly 
placed respectively into 2 nri and 2 nr ' 2 cells. This source partition is tantamount to rate splitting 
in the channel coding problem: the cell index associated with a given sequence plays the role 
of common information and the index of the source within the cell the private information. 
This is then followed by the superposition coding [15]. First generate an auxiliary codeword 
wf for each cell index. The codeword x™ is then generated to be superimposed on top of 
that also carries the source index within the cell. Different from [15] is that the codeword x" 
is statistically dependent on the input source, thereby preserving the correlation contained in 
the original source pair. The common part K, if it exists, can then be put back in the encoding 
process by generating an auxiliary codeword Wq . This codeword, known to both encoders, will be 
used in generating all the other codewords through a superposition code structure. This encoding 
process is illustrated in Fig. 2. 

For decoders, joint typicality decoding is used at both decoders. That is, decoder 1 finds a 
unique s n such that (s n , k n , w%, w?, x?, w%, y?) G T^SKWqWxX^Y^, and decoder 2 finds 
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a unique t n such that (t n , k n , , , x% , , y%) e T^TKW W 2 X 2 W 1 Y 2 ). The above coding 
scheme leads to the following sufficient condition for the lossless transmission of a correlated 
source pair over a DMIC. 

Theorem 1: A source pair (S, T) ~ p(s, t) is admissible for a discrete memoryless interference 
channel p(yiy 2 \xix 2 ) if there exist auxiliary random variables W , W 1: W 2 with joint distribution 



of all the variables factoring as: 

p(s, t, w , w u w 2 , x 1 ,x 2 ) = p(s, t)p(w )p(w 1 \w )p(w 2 \w )p(x 1 \sw 1 w )p(x 2 \tw 2 w ), (31) 
and the following conditions are satisfied: 

H(S\K) < I(SX 1 ;Y 1 \W W 2 K), (32) 

H(T\K) < /(TX 2 ;7 2 |W^, (33) 

H(S) < I(W W 2 SX 1 ;Y 1 ), (34) 

H{T) < J(^ ^iTX 2 ;F 2 ), (35) 

H(S\K) + H(T\K) < I(SX 1 ;Y 1 \W W 1 W 2 K) + I(W 1 TX 2 ;Y 2 \W K), (36) 

H(S\K) + H(T\K) < I(TX 2 ;Y 2 \W W 1 W 2 K) + I(W 2 SX 1 ;Y 1 \W K), (37) 

H(S\K) + H(T\K) < I(SW 2 X 1 ;Y 1 \W W 1 K) + I(TW 1 X 2 ;Y 2 \W W 2 K), (38) 

H{S\K) + H{T) < I(W W 1 TX 2 ;Y 2 ) + I(SX 1 ;Y 1 \W W 1 W 2 K), (39) 

H(S) + H{T\K) < I(W W 2 SX 1 ;Y 1 )+I(TX 2 ;Y 2 \W W 1 W 2 K), (40) 
2H(S\K) + H(T\K) < I(SXi, Y^WqW^K) + I(SW 2 Xi, Y^WqK) 

+I(TW 1 X 2 ;Y 2 \W W 2 K), (41) 
H(S\K) + 2H(T\K) < I{TX 2 - Y 2 \W W X W 2 K) + I(TW\X 2 \ Y 2 \W K) 

+I(SW 2 X 1 ;Y 1 \W W 1 K), (42) 
H(S) + H(S\K) + H(T\K) < /(SXi; Yi|WWi W 2 K) + I{W W 2 SX 1 ; Yi) 

+I(TW 1 X 2 ;Y 2 \W W 2 K), (43) 
H(T) + H(S\K) + H(T\K) < I(TX 2 ; Y 2 \W W 1 W 2 K) + I(W W 1 TX 2 ; Y 2 ) 

+I(SW 2 X 1 ;Y 1 \W W 1 K), (44) 
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where K = f(S) = g(T) is the common part of S and T in the sense of Gacs, Korner [6] 
and Witsenhausen [7]. 

We now discuss some implications of Theorem 1. 

Corollary 1: If there is no common part for the source pair (S,T), i.e., K — 0, let W — Q 
be the time sharing variable. Theorem 1 yields the following sufficient condition for the lossless 
transmission of (S, T) over a discrete memoryless interference channel. 



H(S) < I(SX 1 ;Y 1 \QW 2 ), (45) 

H(T) < I(TX 2 ;Y 2 \QW 1 ), (46) 

H(S) + H(T) < I(SX 1 ;Y 1 \QW 1 W 2 ) + I(W 1 TX 2 ;Y 2 \Q), (47) 

H(S) + H(T) < I(TX 2 ;Y 2 \QW 1 W 2 ) + I(W 2 SX 1 ;Y 1 \Q), (48) 

H(S) + H{T) < I(SW 2 X 1 ;Y 1 \QW 1 ) + I(TW 1 X 2 ;Y 2 \QW 2 ), (49) 
2H(S) + H(T) < I(SX 1 ;Y 1 \QW 1 W 2 ) + I{SW 2 X 1 ;Y 1 \Q) 

+I(TW 1 X 2 ;Y 2 \QW 2 ), (50) 
H(S) + 2H(T) < I(TX 2 ;Y 2 \QW 1 W 2 ) + I(TW 1 X 2 ;Y 2 \Q) 

+I(SW 2 X 1 ;Y 1 \QW 1 ), (51) 

where W 1: W 2 are auxiliary random variables such that the joint distribution of all variables 
can be factored as 

p(s, t, q, w 1 , w 2 , x 1 ,x 2 ) = p(s, t)p(q)p(w 1 \q)p(w 2 \q)p(x 1 \sw 1 q)p(x 2 \tw 2 q). (52) 
The fact that Theorem 1 includes the HK region as its special case comes directly from Corollary 
1. If S and T are independent, choose the joint distribution as 

p(s, t, q, w 1: w 2 , x u x 2 ) = p(s)p(t)p(q)p(w 1 \q)p(w 2 \q)p(x 1 \w 1 q)p(x 2 \w 2 q) : (53) 



and let R\ = H(S) and R 2 = H(T). Corollary 1 yields an achievable region for the interference 
channel which coincides with that described in Proposition 3. 

Consider now another special case where the source has a special correlation structure similar 
to that of [1]. 
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Corollary 2: Suppose that the source (S, T) can be decomposed into three parts: S = (S r , K) 
and T = (T", K) where S', T', K are independent random variables. Choose the joint distribution 

p(s, t, w , wi, w 2 , xi,x 2 ) = p(s')p(t')p(k)p(wo)p(wi\w )p(w 2 \w )p(x 1 \wow 1 )p(x 2 \w w 2 ), (54) 

where s = (s',k) and t = (t',k). Theorem 1 gives the following sufficient condition for the 
lossless transmission of the source pair (S,T). 



H(S') < I(X 1 ;Y 1 \W W 2 ), (55) 

H(T') < I(X 2 ;Y 2 \W W 1 ), (56) 

H(K) + H(S') < I(W W 2 X 1 ;Y 1 ), (57) 

H(K) + H(T>) < IiWoW.X^Yz), (58) 

H{S') + H{T>) < I(X 1 ;Y 1 \W W 1 W 2 ) + I(W 1 X 2 ;Y 2 \W ), (59) 

H{S') + H{T') < I(X 2 ;Y 2 \W W 1 W 2 ) + I(W 2 X 1 ;Y 1 \W ), (60) 

H(S') + H(T r ) < I(W 2 X 1 ;Y 1 \W W 1 )+I(W 1 X 2 ;Y 2 \W W 2 ), (61) 

H{K) + H{S') + H{T') < I(W W 1 X 2 ;Y 2 )+I(X 1 ;Y 1 \W W 1 W 2 ), (62) 

H(K) + H(S')+H(F) < IiWoW^Yj+IiX^WoW^), (63) 
2H(S') + H(T') < J(X i; Y 1 \W Q W 1 W 2 ) + 1{W 2 X X ; Y 1 \W ) 

+I(W 1 X 2 ;Y 2 \W W 2 ), (64) 
H(S') + 2H(T') < I{X 2 - Y 2 \WoW x W 2 ) + I{W X X 2] Y 2 \W ) 

+I(W 2 X 1 ;Y 1 \W W 1 ), (65) 
H(K) + 2H(S') + H(T') < J(X i; Y 1 \W W 1 W 2 ) + J(W W 2 Xi; Yi) 

+I{W 1 X 2 ;Y 2 \W Q W 2 ), (66) 
H(K) + H(S') + 2H{T') < I{X 2 ; Y 2 \W W 1 W 2 ) + I^WqW^ Y 2 ) 

+I(W 2 X 1 ;Y 1 \W W 1 ). (67) 



Corollary 2 can be used to establish that the sufficient condition includes that of [16]— [18] as 
its special case. Specifically, define R = H(K),Ri = H(S') and R 2 = H(T'), the sufficient 
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condition reduces to the rate region of interference channels with common information obtained 
in [16]-[18]. 

IV. Separation is Strictly Suboptimal 

In this section, we give a simple example to show that separate source and channel coding is 
in general not optimal for sending correlated sources over interference channels. 

Consider the transmission of a correlated binary source (S, T) with the joint distribution p(s, t) 
given by 

p( s = 0,t = 0) = ^, (68) 
p(s = 0,* = l) = 0, (69) 
p(s = l,t = 0) = i (70) 
p(s = l,t = l) = 1 (71) 
over an interference channel defined by 

Xx = X 2 = {0,1}, (72) 

= {0,1}, (73) 

3>2 = {0,1,2}, (74) 

Y 1 = X,, (75) 

Y 2 = X 1 +X 2 . (76) 

The source is the same "triangular" source used in [2] and [8] to demonstrate that separation is 
not optimal for communicating correlated sources over MAC and BC, respectively. The channel 
is a special case of the deterministic interference channel studied in [19, Theorem 2] whose 
capacity region is the convex closure of those (i?i,i? 2 ) pairs satisfying 

Ri < H(X ± ), (77) 

R 2 < H(X 2 ), (78) 

R1 + R2 < H(Y 2 ), (79) 
over all the product probability distribution p(x 1 )p(x 2 ). 
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It can be easily calculated that H(S, T) = log 3 = 1.58 bits. On the other hand, if X\ and X 2 
are independent, we have, 

R 1 + R 2 < max H(Y 2 ) = 1.5. (80) 

p(xi)p(x2) 

Thus, H(S,T) > H(Y 2 ) for all p(xi)p(x 2 ). Therefore, lossless transmission is not attainable by 
a simple concatenation of the Slepian-Wolf code followed by an optimal channel code. This is 
illustrated in Fig. 3 where the capacity region for the interference channel and the Slepian-Wolf 
rate region of the source pair do not intersect. However, it can be easily checked that a trivial 
way to reliably transmit this source is to choose X\ — S and X 2 = T, which results in zero 
error probability at both receivers. This example shows that separate source and channel coding 
is strictly suboptimal. 

2 
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0.8 
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- Slepain-Wolf region 

- IC capacity region 




Fig. 3. The Slepian-Wolf region and the IC capacity region. 

One can also easily check that this special case is included in Theorem 1. Let K = W = 
W\ = W 2 — (f), X\ — S, and X 2 = T, the condition in Theorem 1 reduces to 

H(S) < 1(5; K0, (81) 
H(T) < I(T;Y 2 ). (82) 

The first inequality is obviously satisfied given that Y\ = S. To check the second inequality , 
note that since Y 2 = S + T, 

I(T; Y 2 ) = H(S + T) — H(S + T\T) = H(S + T) - H(S\T). (83) 
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Thus the second inequality reduces to 

H(S,T) < H(S + T) = log3, (84) 
which is also satisfied for the given source pair. 

V. Conclusion 

In this paper, we studied the problem of communicating an arbitrarily correlated source over a 
discrete memoryless interference channel. Using the techniques of correlation preserving coding 
and random source partition, a sufficient condition was derived for reliable transmission of cor- 
related sources over interference channels. The proposed region includes the Han and Kobayashi 
achievable rate region for general interference channels as its special case. Furthermore, it 
includes the known rate region for interference channels with common information as its special 
case when the course correlation is in the sense of [1]. Finally, a simple example is given to 
show that separate source and channel coding is strictly suboptimal for communicating correlated 
sources over interference channels. 

Appendix - Proof of Theorem 1 
Theorem 1 can be obtained via Fourier-Mortzkin elimination from the following constraints. 



H(S\K)- ri 


< 


I(SX 1 ;Y 1 \W W 1 W 2 K), 


(85) 


H{S\K) 


< 


I(SX 1 ;Y 1 \W W 2 K), 


(86) 


H{S\K)-r l +r 2 


< 


I(SW 2 X 1 ;Y 1 \W W 1 K), 


(87) 


H(S\K) + r 2 


< 


I(W 2 SX 1 ;Y 1 \W K), 


(88) 


H(S) + r 2 


< 


I(W W 2 SX 1 ;Y 1 ), 


(89) 


H(T\K)-r 2 


< 


l(TX 2 ;Y 2 \W Q W x W 2 K), 


(90) 


H(T\K) 


< 


I(TX 2 ;Y 2 \W W 1 K) : 


(91) 


H(T\K)-r 2 + n 


< 


1{TW X X 2 ;Y 2 \W Q W 2 K), 


(92) 


H(T\K) + n 


< 


I(W 1 TX 2 ;Y 2 \W K) : 


(93) 


H(T) + n 


< 


J(WWiTX 2; y 2 ), 


(94) 
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ri > 0, (95) 
r 2 > 0. (96) 

Therefore, it suffices to prove, for decoder 1, that equations (85-89) constitute a sufficient 
condition. As sketched in Section III, the coding scheme involves Cover-El Gamal-Salehi's [2] 
correlation preserving coding and also Han and Costa's [8] random source partition. 

a) Random partition of the source sequences: Let r\ > 0,r 2 > be any nonnegative real 
numbers. Randomly place source sequences S n G S n into 2 nri cells and denote the cell index 
for a given s n by a = k(s n ) e h — {1, 2, • • • , 2™" 1 }. Similarly, randomly place each T n e T n 
into 2 nr2 cells and denote the cell index for a given t n by (3 = l 2 (t n ) e I 2 = {1, 2, • • • , 2 nr2 }. 
For this random source partition, we have the following lemma as in [8]. 

Lemma 1: Let S ,T be any subset of S n and T n , respectively. Then for any a e h and 
13 E I 2 , we have, 

^(|{ S n G5 }:/ 1 (s") = a|) = |5 |x2— \ (97) 

^(|{t"GT }:/ 2 (r)=/3|) = |T |x2- OT2 , (98) 

where £{■} denotes the expectation. 

b) Codebook generation: For any given joint distribution defined in (31), we first calculate 
the following distributions: p(w ) : p(wi\w ), p(w 2 \w ), p(x 1 \w w 1 s) and p(x 2 \w w 2 t). 

For each k n e /C n , independently generate one w t q sequence according to YYi=iP( w oi)- 
Index them by Wq(/c™). For each source sequence s n , find its cell index a and the correspond- 
ing auxiliary sequence Wq(/(s ti )), and independently generate one codeword w™ according to 
[\™ =1 p(wii\w 0i ). Index them by u>"(a;, Wq). Next, for each s n , find the corresponding Wo(/( s ™)) 
and Wi(a, Wq), independently generate one codeword x™ according to Yli=iP( x ii\ w oiWiiSi). 
Index them by x"(s n , , «;"). Similarly, generate codewords w^P^Wq) and ^(t 71 , Wq, Wg) for 
user 2. 

Notice that, for user 1, there are three set of codewords: -u7q (&; n ), (a, it>o) an d x"(s n , , tu" ). 
Here, Wq (k n ) carries the information corresponding to the common part of the sources; w±(a, Wq) 
carries the information of the cell index of the source s n which is superimposed on top of Wq ; 
Xi(s n , Wq , Wi) carries the private information of the source s n and is superimposed on top of 
both Wq and The codebook structure for user 2 is similar. 
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c) Encoding: Upon observing s n , encoder 1 finds the cell index a = h(s n ), codewords 
w o(f( sU )) an d w™(ot,Wo), and then sends the corresponding x™(s n , Wq , w"). Similarly, encoder 
2 sends x%(t n ,w$,w%). 

d) Decoding: Upon receiving y", decoder 1 declares s n = s n to be the transmitted source 
sequence if s n is the unique sequence such that 

(s n , k n , <, <, x\, u£, O G T^(SKW W 1 X l W 2 Y 1 ). (99) 

Similarly, decoder 2 finds the unique i™ such that 

(t n , fc n , <, wl xl <, y 2 n ) G T?(TKW W 2 X 2 W 1 Y 2 ). (100) 

e) Error analysis: Encoding error occurs only if the source sequence pairs (s n ) t n ) ^ T™(ST) 
whose probability is bounded by e from the asymptotic equipartition property (AEP) [20]. By 
symmetry, we only need to consider the decoding errors at receiver 1 . 

Suppose (so,io) e 316 tne source outputs, with k% = /(sq) — fl'(^o)- Without loss of 
generality, we assume that a = 1 and (3=1, i.e., Zi(sq) — 1 an d ^2(^0) = 1> an d a l so w o(K) = 
Wq . Then an error occurs if any one of the following events happens: 

2) £ , i 2 : there exists some s n 7^ Sq m me cell a — 1, i.e., /i(s n ) = 1, and (3=1, such that, 

( S ^A; ^<(A; ™),<(l,<),xn5^<,<),^ ^ ; 2 ^ (l,<), ^ /r) £ T e "(5if ^AM). 

3) i?i 3 : there exists some s n 7^ Sq in the cell a — 1, i.e., /i(s n ) = 1, and (3^1, such that, 
(V, fco, utf <), rr"(s n , it#, w?),w%(P, w£),y^ G T? (SKW W 1 X 1 W 2 Y 1 ). 

4) .E14: there exists some s 11 7^ Sq in the cell a^l, i.e., /i(s n ) = a, and (3=1, such that, 
(V\ fc» <(££), x?(s",<, 0,^(1,0,^) er^OToM^). 

5) -E15: there exists some s n 7^ Sq in the cell a^l, i.e., h(s n ) = a, and (3^1, such that, 

6) -E^: there exists some s n 7^ Sq in the cell a^l, i.e., /i(s n ) = a, and (3^1, such that, 
fc n = /( s ») 7^ fc» <(A; n ) 7^ 

and (s n ,A; n ,<(A; n ),^(Q;,<),^(s n ,<,^),w 2 t (/3,<),y^ G T^STrWbWiXiWbyi). 

7) E^: there exists some s n 7^ Sq in the cell a^l, i.e., li(s n ) = a, and (3^1, such that, 

= f(s n ) ^ fcj, u#(£; n ) = utf(A#) 
and (s n ,A; n ,<(/c n ),^(Q;,<),^(s n ,<,^),w 2 t (/3,<),y^ G ^(STTWbWiXiWbyi). 
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Hence, the probability of error at decoder 1 is 



7 



P el = Pr{\J i=1 E u ) < J2 Pr{E lt }- (101) 

i=i 

We evaluate the probabilities of the seven error events individually. First, by the AEP, 

Pr{E u } < e, (102) 
for sufficiently large n. For the second event, we have, 1 

Pr{E 12 } 

= S( £ Pr((^^<(A; "),<(l,<),^(^<,<), W2 "(l,<),^) elf), 

s"6£i(l)nT™(5) 

= e{ E E p(*x«r)p(swi«x<)). 

s«6£i(l)nT™(5) (s",A; n ,'U)g-,TOy,a;y,TOj,j/y)eT« 

< s( E |T™(Sin^ ^i^i^2^i)|2~ n(H(w ° m ^ 

s"e£i(i)nr™(5) 

< ^2 2 n ^ H ^ SKWoWlXlW2Yl )- H ^ KWoWlW2Yl ^2~ n ^ H ^ 
s"e£i(i)nr™(S) 

_ £^ ^ 2™(- ff ( s 'l xw 'o wr i w '2)+-ff(x 1 yi|5i : s:iyoH / iVK2)) 
s"e£i(i)nT™(S) 

,2-"(^(>i|^W'oW r iW'2)+-ff(5)+/i'(Xi|5VKiW'o)-4e) j 

_ ^2 2 n ( H ( s W +H ( ¥l \ SKWoWlW2Xl V2~ n ( H ^ +H ( Yl ^^ 

s n eCi(i)r\T?(s) 

< 2™(^( 5 )+ e - r i)2- n ( / ( 5Xi;yi l A " w ' oH/lW ' 2 ) +/ ( 5; ^)) +4e ) 

_ 2 ri W s 'l A ")- r i- / ( s ' x i; Y il xw 'o^iW2)+5e) ^Q3^ 

For the third event, we have, 

Pr{E 13 } 

= £ { E E^^^^Ka,^)^!^^^),^,^),^)^^)), 
= ^( E E E p( s n )p(^w)p(^| S "< w r)p(^<^ryr)), 

'For notational ease, we use T™ to denote the typical set T"(SKW WiX 1 W 2 Y 1 ) below. 
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s"e£i(i)nT™(5) ^1 
_ £^ ^2 ^22 n ^ H ^ KWoW ^ +H ^ W2XlYl ^ SKWoWl ^ 

s"6£i(l)nT"(5) /3^1 
.2-n(^(5 , )+.H'(W / 2|Wo)+ J H'(Xi|iyiWo5)+i/(yi|XWoVKi)-5e) j 

< 2™(^( S ')+ e - r l+ r 2)2- ri ( / ( S ''^)+ / (' S ' H/ 2 X i; y il XW '0 W 'l)- 5e ) 
_ 2™W S 'l X )- r i+ r 2-^(S'VK2Xi;Yi|^WoWi)+6e) 

For the fourth event, we have, 

Pr{E u } 

= £ {H E pr(( s ^A; ^<,<(a,<),^( s ^<,<),<(l,<),y^)e7^)), 

a^l s»e£i(o)nT E »(S) 

= *(£ E E p( s ")p(<|<)pK|^< w r)pK)p(^2yrko)), 

< 2™W 5 )+ e )2 n ( H ( 5 ^ w °^ lW2Xiyi )2~™^ w ^ 

_ 2™(' H '( S ')- / ( S ' W 'i X i^ W '2yi|Wo)+7e) 

_ 2™(^( 5 )- / ( S ^i X i^2|W' )-/(5Xi;yiX|W' H/2))2-n(^(^i;>i l^o^Xi 5)-7e) 

(_^_) 2™(' H '( S ')- / (' 5 ' X i; y l i ^l W 'oW2)+7e) 

_ 2™(^( 5 )- / ( S ^l W/ oVK 2 )-/(Xi;_ft:|W'oVK25))2-n(/(S'Xi;yi|XW"oW'2)-7e) 

= 2™W 5 l x )- / ( 5X i; y il w oW2)+7e) ^ 105 ^ 

where (a) is because Wi — > W — ► SWiXl and W 7 ! — > SW 2 Xi — > ^1 form Markov chains. 
For the fifth event, we have, 

Pr{E 15 } 

= ^(E E E Pr (^^<<(«,<)^i(^<,<)^2(A<),^)e^)), 

a^l s»e£i(a)nT e »(S) /3^1 

= *(£ E E E p( S ")p(^ri<)p(^i<)p(x 1 | S "<<) P (^< y r)), 

< 2™W 5 )+ r 2+ e )2™W 5 ^ WoWlW 2^iy)-#(^w^ 
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_ 2 n ( H ( S ) +r 2+ H ( SKX i Y i\ w oWiW 2 ))2-n(H(KY 1 \W () )+H(S)+H(X 1 \SW W 1 )-7e) 
_ 2 n ( H ( s )+ r 2+ H ( sx i Y i\ KW oWiW 2 ))2-n(H(Y 1 \KWo)+H(S)+H(X 1 \SWoW 1 )-7e) 
_ 2 n ( H ( S )+ r 2+ H ( s \ K )+ H ( x i Y i\ SKW oWiW2))2-n(H(S)+H(Y 1 \KW )+H(X 1 \SW 

_ 2 n ( H ( s \ K )+ r ^- I ( sw ^ x ^ Y i\ KW o)+ 7e ) 

_ 2 n (^( S l^)+ r 2-/(W / 2 5Xi;y 1 |i^W'o))2-™(/(VKi;Yi|Si<"lV'oW2X 1 )-7e) 

= 2 n ( H ( S \ K ) +r 2- I ( W 2S x i; Y i\KW )+7e) ^ 106 ^ 

For the sixth event, we have, 
Pr{E w } 

= <E E E' 

a^l s»e£i(«)nT e "(S) p^i 

Pr(^A^«tf(fc B ),«;;^ 

= <E E EE pK = o 

•Pr(s",*», <(*"), <(a,0,x?( S ",<,0, UI ?(/3,0, ! /J«) 6 T,")K" # <„)), 

= <E E E E E f«) 



P ( s n r« w x)p(i/")), 

< 2 n ( H ( 5 )+ r 2+ e )2 n ( H W>) +e )2~ n ( H ^°) +e )2 n ^^ 
_ 2 n ( H ( s ) +r2 - I ( SKW ° WlW2Xv ' Yl ) +4t ) 

_ 2 n ( H ( S )+ r2 - I ( SW o W 2 x U Y i)-HWv,Y 1 \SW W2X 1 )+4e) 

= 2 n ( H ( S )+ r 2- I (SW W 2 X 1 ;Y 1 )+4e) ^Qy^ 

For the last event, we have, 

Pr{E 17 } 

= ^(E E E Pr ( s ^ fc ^<( A;n )'<( a ' w o)' a; i( sn '<' w o)' 

a^l s»e£i(«)nT»(S) p+\ 
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= ^(E E E E p(<)p(< = «'So)Pr( S B ,fc B ,<(fc B ),ti;r(a,<), 
x?(a B ,«),«;JC9,0,yr) G 7?|< = < )), 

= ^(E E E E E p«)p« = «'So) 

< 2n(#(S)+r 2 +e)2n(tf(Wo)+e)2-n(tf(VF^^ 

_ 2 n (^(5')+''2--f/(Wo)-/(5_ft:WiW2X 1 ;YiHVo)+7e) 

_ 2 n (^(S')+r 2 -H(Wo)-/(5H'2X 1 ;yiHVo)+7e) ^Qg 

From (103)-(108), if the following conditions are satisfied, then the probability of error at 
decoder 1 will vanish as n goes to infinity. 



H(S\K)-n < IiSX^Y^WoW^K), (109) 

H(S\K) < I(SX 1 ;Y 1 \W W 2 K), (110) 

H(S\K)-n + r 2 < I(SW 2 X 1 ;Y 1 \W W 1 K), (111) 

H{S\K)+r 2 < I(W 2 SX 1 ;Y 1 \W K), (112) 

H(S)+r 2 < I(W Q W 2 SX 1 ;Y 1 ), (113) 

H(S)+r 2 < I(W 2 SX 1 ;Y 1 \W )+H(W Q ). (114) 

One can easily check that (114) is dominated by (113), since, 

I(W 2 SX 1 ;Y 1 \W ) + H(W ) = H^Wq) + H(W ) - H^SW^X^), (115) 

> H(Y 1 )-H(Y 1 \SW W 2 X 1 ), (116) 

= I(W W 2 SX 1 ;Y 1 ). (117) 

This establishes (85-89). Similarly, (90-94) can be established symmetrically for decoder 2. 
The proof of Theorem 1 is complete by applying the Fourier-Mortzkin elimination to (85-96). 
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